Technical report : Adaptivity and optimality of the monotone least squares estimator for four different models
نویسنده
چکیده
In this paper we will consider the estimation of a monotone regression (or density) function in a fixed point by the least squares (Grenander) estimator. We will show that this estimator is fully adaptive, in the sense that the attained rate is given by a functional relation using the underlying function f 0 , and not by some smoothness parameter, and that this rate is optimal when considering the class of all monotone functions, in the sense that there exists a sequence of alternative monotone functions f 1 , such that no other estimator can attain a better rate for both f 0 and f 1. We also show that under mild conditions the estimator attains the same rate in L q sense, and we give general conditions for which we can calculate a (non-standard) limiting distribution for the estimator.
منابع مشابه
Adaptivity and optimality of the monotone least squares estimator
In this paper we will consider the estimation of a monotone regression (or density) function in a fixed point by the least squares (Grenander) estimator. We will show that this estimator is fully adaptive, in the sense that the attained rate is given by a functional relation using the underlying function f0, and not by some smoothness parameter, and that this rate is optimal when considering th...
متن کاملProposed Procedure for Estimating the Coefficient of Three-factor Interaction for 2^p 3^m 4^q Factorial Experiments (TECHNICAL NOTE)
Three-factor interaction for the two-level, three-level, and four-level factorial designs was studied. A new technique and formula based on the coefficients of orthogonal polynomial contrast were proposed to calculate the effect of the three-factor interaction The results show that the proposed technique was in agreement with the least squares method. The advantages of the new technique are 1) ...
متن کاملA New Light from Old Wisdoms : Alternative Estimation Methods of Simultaneous Equations with Possibly Many Instruments
We compare four different estimation methods for a coefficient of a linear structural equation with instrumental variables. As the classical methods we consider the limited information maximum likelihood (LIML) estimator and the two-stage least squares (TSLS) estimator, and as the semi-parametric estimation methods we consider the maximum empirical likelihood (MEL) estimator and the generalized...
متن کاملAdaptive Risk Bounds in Unimodal Regression
We study the statistical properties of the least squares estimator in unimodal sequence estimation. Although closely related to isotonic regression, unimodal regression has not been as extensively studied. We show that the unimodal least squares estimator is adaptive in the sense that the risk scales as a function of the number of values in the true underlying sequence. Such adaptivity properti...
متن کاملFitting Second-order Models to Mixed Two-level and Four-level Factorial Designs: Is There an Easier Procedure?
Fitting response surface models is usually carried out using statistical packages to solve complicated equations in order to produce the estimates of the model coefficients. This paper proposes a new procedure for fitting response surface models to mixed two-level and four-level factorial designs. New and easier formulae are suggested to calculate the linear, quadratic and the interaction coeff...
متن کامل